Evaluating Three Scrutability and Three Privacy User Privileges for a Scrutable User Modelling Infrastructure

This paper describes the evaluation of a Scrutable User Modelling Infrastructure. SUMI is intended to form a service to allow users to share their user models from social e-networking and e-commerce providers to educational systems. The model is scrutable, meaning users can inspect and correct the data that is held about them, and implements privacy policies so that users can control how their models are accessed by other users. This evaluation was conducted with 107 users, which were exposed to a prototype service, for determining whether the proposed scrutability and privacy privileges were acceptable to the users, whether the users were able to achieve the desired outcome, and whether they understood the consequences of their interactions with the system. The conclusions show that the users expressed their general approval of the proposed privileges while making useful suggestions regarding improvements to the presentation and interface to the system.